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OPTIMUM  MEMORYLESS  NONLINEAR  TRANSFORMATION 
FOR  WEAK  NARROWBAND  SIGNALS  IN  NOISE 

INTRODUCTION 

For  strong  additive  noise  that  is  not  Gaussian,  a  nonlinear 
transformation  that  suppresses  the  noise,  but  passes  the  signal, 
is  useful  in  aiding  in  the  detection  of  weak  signals.  Here,  we 
will  first  review  the  standard  memoryless  nonlinear  transforma¬ 
tion  of  a  lowpass  real  waveform  composed  of  signal-plus-noise  or 
noise-alone  and  maximize  the  deflection.  A  problem  arises  for 
the  "optimum"  nonlinearity,  which  indicates  the  possibility  of 
infinite  deflection;  this  behavior  is  traced  to  a  shortcoming  of 
the  approximate  analysis,  and  a  method  for  circumventing  it  is 
presented. 

Then,  we  extend  these  ideas  to  a  narrowband  waveform  contain¬ 
ing  both  amplitude  and  phase  modulation  on  the  signal  as  well  as 
the  noise.  In  both  cases,  a  deflection  measure,  for  small  input 
signals  with  arbitrary  characteristics,  will  be  maximized  by 
choice  of  the  arbitrary  meraoryless  nonlinearity  characteristic. 
The  presence  of  a  spurious  weak  signal  component  at  the  non¬ 
linearity  output  will  be  fully  discussed  and  treated  in  two 
different  ways.  Also,  the  apparent  infinity  of  the  "optimum" 
nonlinearity  and  its  corresponding  deflection  will  be  thoroughly 
investigated,  and  a  method  will  be  presented  for  ameliorating  the 
shortcomings  of  the  approximate  analysis. 
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Some  of  the  results  of  this  investigation  confirm  those  in 
[1,2].  However,  we  give  a  full  derivation  of  the  method  and  elab¬ 
orate  at  length  on  how  to  handle  the  spurious  signal  component 
and  anomalous  behavior.  Additionally,  the  loss  of  detectability, 
caused  by  the  desire  to  completely  suppress  the  spurious  signal 
component,  is  evaluated  quantitatively. 

A  complete  derivation  of  the  optimum  nonlinearity  operating 
in  the  presence  of  noise  with  phase  dependence  of  a  particular 
kind  is  also  presented.  The  corresponding  maximum  deflection  is 
derived  in  terms  of  the  amplitude  and  phase  difference  probabil¬ 
ity  density  functions.  The  anomaly  for  small  noise  amplitudes  is 
discussed  and  illustrated  by  examples. 
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LOWPASS  REAL  WAVEFORM 


Received  real  waveform  x(t)  is  composed  of  signal-plus-noise 
or  noise-alone,  where  the  additive  noise  n(t)  is  considerably 
stronger  than  the  signal  and  can  be  non-Gaussian .  That  is,  input 


x(  t ) 


'  s(t)  +  n(t)  ' 

or  , 

.  n(t) 


(1) 


where  s(t)  is  the  signal  waveform  with  arbitrary  characteristics. 
This  waveform  is  passed  through  arbitrary  memoryless  nonlinearity 
g  giving  output 


'  g { s ( t )+n( t ) }  ' 

'  y^t)  ' 

y(  t)  -  g{x( t ) }  -  < 

or 

>  9  < 

or 

.  g{n( t ) } 

-p 

o 

>i 

Transformation  g  need  not  be  analytic. 

MEAN  OUTPUTS 

For  a  given  signal  amplitude  s(t)  at  time  t,  the  mean  output 

of  the  nonlinearity  is  given  by  averaging  over  the  noise 
★ 

statistics: 

y1( t )  -  g{ s( t)  +  n( t ) }  -Jdup(u)g{s(t)+u},  (3) 


integrals  without  limits  are  over  the  range  of  nonzero  inte¬ 
grand  . 
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where  p  is  the  known  probability  density  function  of  noise  n(t) 
at  time  t.  (We  have  suppressed  any  t  dependence  of  p,  but  this 
analysis  allows  for  nonstationary  additive  noise,  if  need  be.) 

Now  let  the  change  of  variable,  x  -  s(t)  +  u,  be  made  in  (3)  to 
get 

yx( t)  -  J  dx  p(x  -  s ( t ) )  g{x}  -  (4) 

s  |  dx  (p(x)  -  s(t)  p'(x)]  g{x)  ,  (5) 

where  we  expanded  the  noise  probability  density  function  p  about 
the  point  x,  through  linear  terms  in  (weak)  signal  amplitude 
s(t). 

A  note  of  caution  is  in  order  regarding  expansion  (5).  Since 
x  can  range  over  (-<■»,+«),  we  are  presuming  that  probability 
density  function  p(x)  has  a  local  tangent  for  all  x;  that  is, 

P ( x )  has  no  discontinuities  in  slope.  If  we  attempt  to  employ 
the  following  results  on  a  density  p(x)  that  violates  this 
condition,  the  conclusions  may  be  incorrect  and  a  closer 
investigation  is  warranted. 

For  noise-alone,  we  set  s(t)  -  0  in  (4)  to  get  mean  output 

yo(t)  -  J  dx  p(x)  g{x)  .  (6) 

The  difference  in  mean  outputs,  that  is,  signal-present  versus 
signal  absent,  follows  from  (5)  and  (6)  as  the  approximation 

yl(t>  “  y0(t)  “  “  s(t>  J  dx  P'(x>  9( x }  •  (7) 
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This  is  an  approximation  to  the  deflection  since  it  utilizes 
(5).  Therefore,  the  following  results  based  on  (9)  are  also 
approximations . 
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MAXIMUM  DEFLECTION 


We  would  like  to  maximize  this  small-signal  deflection  at  the 
nonlinearity  output  by  choice  of  the  nonlinearity  characteristic 
g.  However,  two  observations  should  be  made.  First,  the  abso¬ 
lute  scale  of  g  is  immaterial  to  the  deflection;  that  is,  a  g{x} 

2 

obviously  gives  the  same  deflection  d  as  does  g{x}.  Second,  an 

additive  constant  to  g  does  not  affect  the  deflection;  that  is, 

2 

g{x}  +  b  gives  the  same  value  of  d  as  does  g{x}.  This  is  easily 
verified  by  direct  substitution  of  g{x}  +  b  for  g{x}  in  (9), 
whereupon  b  is  seen  to  cancel  out  everywhere.  More  generally, 
nonlinearity  a  g{x}  +  b  gives  the  same  deflection  as  g{x}. 

What  this  means  is  that,  without  loss  of  generality,  we  can 
set  the  nonlinearity  mean  output  for  noise-alone,  yQ ( t ) ,  equal  to 
zero,  and  not  detract  from  the  attainable  values  of  deflection 
criterion  (9).  So,  setting  (6)  to  zero,  (9)  becomes 


s2(  t) 


[  dx  p'(x!  g(x}  2 
—  —  -j— 

dx  p ( x )  g2{x} 

% 


(10) 


But  now,  by  Schwartz's  inequality,  this  ratio  is  maximized  by  the 
optimum  memoryless  nonlinearity 


9m<x> 


P'  (x) 

p(  X ) 


-  In  P(x) 


(11) 


Here,  we  have  taken  advantage  of  the  scaling  independence  in 
order  to  supply  the  factor  -1  for  convenience.  The  resulting 
maximum  deflection  is 
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dm  -  s2(tl  J  dx  E5TJTi  '  <12) 

Substitution  of  optimum  nonlinearity  (11)  into  noise-alone 
mean  output  (6)  immediately  yields  zero,  consistent  with  the 
assumption  utilized  in  reducing  (9)  to  (10).  We  should  also 
notice  that  signal  value  s(t)  appears  as  a  multiplicative  term  in 
general  deflections  (9)  and  (10);  thus,  the  optimum  nonlinearity 
gm  can  be  selected,  as  in  (11),  without  regard  to  the  particular 
signal  amplitude.  It  also  allows  s(t)  to  be  deterministic  or 
random,  as  the  case  may  be.  These  approximations  are  all 
predicated  on  the  small-signal  assumption  utilized  in  (5). 


EXAMPLE 


As  an  example  of  (11)  and  (12),  consider  Caussian  noise  for 

which 


p(x) 


exp 


(x  - 


21 


for  all  x  . 


As  noted  under  (5),  this  probability  density  function  has  no 
discontinuities  in  slope.  Substitution  in  (11)  and  (12)  gives 


and 


9m{x} 


x  -  u 


n 


n 


for  all  x 


s2(  t 


m 
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Thus  the  (approximate)  optimum  nonlinearity  is,  in  fact,  linear, 
and  the  maximum  deflection  is  the  instantaneous  signal-to-noise 
power  ratio  at  the  input  to  the  nonlinearity. 

By  the  arguments  given  in  the  sequel  to  (9),  we  could  equally 
well  use  nonlinearity 

§mf*}  -  X 

2 

and  realize  the  same  maximum  deflection  d  .  This  latter  nonlin- 

m 

earity,  §m,  would  have  a  nonzero  noise-only  mean  output,  namely 
Vn;  however,  this  is  not  a  problem  since  it  is  known  and  could  be 
subtracted  from  the  output  of  §m,  if  desired. 

in  the  general  case,  we  can  always  use  (modified)  optimum 
nonlinearity 

gm(xl  -  a  gm(x)  *  b 

2 

instead  of  (11)  and  still  get  maximum  deflection  d„  in  (12), 

m 

where  a  and  b  can  be  chosen  for  convenience.  The  major  differ¬ 
ence  is  that  the  noise-only  mean  output  is  then  b,  not  zero; 
however,  since  b  is  known,  this  constitutes  no  limitation  or 
problem. 
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PHYSICAL  INTERPRETATION 

The  general  situation  is  depicted  in  the  series  of  plots  in 
figures  1-3.  The  noise-only  output  yQ(t)  is  given  on  the  left 
side  of  each  plot,  while  the  signal-plus-noise  output  y^t)  is 
given  on  the  right  side.  The  mean  of  each  waveform  is  indicated 
by  a  horizontal  dashed  line.  Figure  1  represents  the  starting 
point  of  the  analysis,  namely  (2).  Figure  2  indicates  the  output 
waveforms  for  the  case  of  the  optimum  nonlinearity  gm  in  (11), 
that  is,  y  (t)  now  has  zero  mean.  The  nonlinearity  g  maximizes 
the  ratio  of  the  mean  of  y^t)  to  the  standard  deviation  of 
yQ(t).  Finally,  figure  3  biases  both  yQ(t)  and  y^(t)  by  constant 
b  and  scales  both  by  factor  a;  it  represents  the  outputs  of  non¬ 
linearity  g  . 

Another  note  of  caution  is  in  order  relative  to  approxima¬ 
tions  (11)  and  (12).  If  p(x)  is  zero  at  any  value  of  x,  the 

optimum  nonlinearity  gm  approaches  infinity  at  that  point,  and 

2 

the  maximum  deflection  d  may  become  infinite  as  well.  This  is 

m  •* 

physically  unrealistic  and  indicates  that  certain  forms  of  the 
noise  probability  density  function  p  are  disallowed  or  that  the 
approximations  have  gone  awry.  For  example,  if  p  approaches  zero 
at  an  isolated  point,  it  must  do  so  faster  than  linearly  in  order 
that  integral  (12)  remain  finite  from  the  contribution  in  the 
neighborhood  of  that  point.  However,  integral  (12)  is  itself  an 
approximation  and  must  also  be  investigated  more  closely. 
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This  possibility  of  infinite  deflection  is  not  entirely  due 
to  inadequacy  of  the  approximation  utilized  in  (5)  et  seq.  In 
general,  if  we  use  (4),  (6),  (8),  and  the  upper  line  of  (9),  we 
have,  for  any  g,  exact  deflection 


d2  ( s ) 


J  dx  tp(x-s)  -  p(x) 1 
J  dx  p ( x )  g2{x} 


9 


where  we  have  replaced  s(t)  by  s  for  notational  brevity.  Now 
suppose  that  we  consider  signal  value  s  known  and  that  non¬ 
linearity  g  can  be  chosen  with  this  knowledge.  The  optimum 
nonlinearity  is  then  (with  no  approximations) 


ge{*;s} 


p(x-s)  -  P ( X )  _  p(x-s ) 
p(x)  p(x) 


Although  it  is  physically  unrealistic  to  presume  signal  value  s 
known,  this  approach  is  informative  in  that  it  pinpoints  the 
source  and  rate  of  approach  of  the  infinities.  It  is  immediately 
seen  that  if  p(x)  approaches  zero  somewhere,  then  gg{x;s} 
approaches  infinity  at  that  x  value  (unless  s  -  0 ) .  The 
corresponding  maximum  deflection  for  nonlinearity  gg{x;s}  is 


d2(s) 


P2(x-S) 
p(x ) 


1  , 


and  will  remain  finite  only  if  p  approaches  zero  less  fast  than 
linearly.  Thus,  the  condition  on  the  rate  of  approach  of  p  to 
zero,  in  order  to  maintain  finite  deflection,  is  reversed  from 
the  conclusion  above  based  on  approximation  (5).  This  reversal 


11 


TR  8611 


is  very  important  to  know  about,  but  the  possibility  of  infinite 
deflection  still  remains. 

If  we  now  make  the  small-signal  assumptions  on  the  exact 
results  above,  we  find 


9eU?s}  - 


P'  (x) 
p(x) 


9m<*> 


de(s>  " 


p(  x) 


consistent  with  (11)  and  (12),  respectively.  (The  multiplicative 

factor  of  s  in  ge{x;s}  is  merely  an  irrelevant  scale  factor,  as 

far  as  the  deflection  is  concerned. )  No  nonlinearity  can  outper- 
_2 

form  dg(s)  for  any  signal  value  s,  since  the  latter  result  allows 

2 

for  use  of  knowledge  of  p(x)  as  well  as  value  s.  So  if  dm  in 
(12)  gives  a  result  larger  than  d^(s),  it  means  that  the  approxi¬ 
mation  giving  rise  to  (12)  was  faulty.  In  that  case,  we  should 

_2 

revert  to  exact  deflection  d  (s)  and  substitute  the  particular 
nonlinearity  g  being  employed.  For  example,  if  approximate 
optimum  nonlinearity  gm  in  (11)  is  utilized,  the  corresponding 
deflection  is  found  to  be 


dm(s) 


[J  dx  p(x-s)  pf (x)/p( x) 
r  dx  p'2(x)/p(x) 


2  2 

Of  course,  cT“(s)  <  3“(s)  in  all  cases, 
m  ■  e 

Some  examples  are  useful  at  this  point.  For  Gaussian  noise, 
we  have 
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p(x)  -  (2n)-1*  exp(-x2/2)  for  all  x  , 


9  { x  > 
’nr  ' 


p(x) 


>'  (*)  .  s2 
P(X)  S 


—2  2 
d“(s)  -  , 

m 


9e{x;s}  -  exp  ^sx  -  |s2j  -  1  ~  sx  -  s  gm(x}  , 


d2 ( s )  -  exp( s2 )  -  1  -  s2  -  d2 

e  in 


—2  2 

The  quantity  dg(s)  is  larger  than  dm  for  all  s  (except  s  -  0) 
All  of  these  results  are  self  consistent. 

For  exponential  noise. 


p(x)  -  j  exp(-|x|)  for  all  x 

9m<x|  -  -  fuf1  '  S3nU)  ’ 


<  -  **  I 


s2  , 


t(s)  -  [l  -  exp(  -  |  s  |  ;  j  2  ~  s2  -  |  s  |  3  , 


ga{x;s)  «  exp( - ( x-s |  +  |x|)  -  1  , 


d2( s )  -  |  exp( | s | )  +  y  exp( -2 | s | )  -  1  -  s2  -  j  | s | 3 


Now ,  cT^(s)  is  less  than  for  0  <  |s|  <  2.07;  thus  the  approxi- 

2  2 

mation  d”  is  somewhat  optimistic  and  cr{s)  should  be  used  in- 
m  m 

stead.  A  sketch  of  nonlinearity  gg(x;s}  reveals  that  it  resembles 
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s  sgn(x),  especially  for  small  s.  This  example  is  consistent 
2 

except  for  dm,  despite  the  fact  that  p'(x)  is  discontinuous  at 
the  one  point  x  ■  0. 

For  a  noise  probability  density  function  with  a  zero  (at  the 
origin  for  convenience),  we  have,  for  example. 


p ( x )  -  a  |x|v  exp( - 1 x | ^ )  ,  v  >  0,  jj  >  0, 


■  -  frit1  ~  ~  x  as  x  ■* 0  ■ 


dm  *  s2  I  dx  Ejuf^  <  *  1£  v  >  1  ’ 


d^(s)  -  0  if  v  <  1  , 
m 


?e  f x  * s  j  -  - 1  - 

a  1 x I 


as  x  ■+  0  , 


d^(s)  < 


if  v  <  1  . 


As  anticipated,  the  condition  for  finite  deflection  is  reversed 

in  the  exact  result  (v  <  1)  versus  the  approximation  (v  >  1).  In 

addition,  the  rate  of  growth  of  the  optimum  nonlinearity  near 

x  -  0  is  milder  for  the  exact  result  and  of  a  very  different 

character.  The  reason  that  3/?(s)  is  zero  for  v  <  1  is  that 

m 

p'(x)/p(x)  -  1/x,  whereas  p'^(x)/p(x)  -  xv_  as  x  *»  0+;  thus,  the 
integrand  of  the  denominator  of  d^(s)  has  a  higher-order  sing¬ 
ularity  at  x  ■  0  and  approaches  infinity  at  a  faster  rate  than 
the  numerator.  This  example  exemplifies  the  need  for  close 
scrutiny  of  a  noise  probability  density  function  which  has  a  zero 
value  anywhere  in  its  range. 


14 


TR  8611 


NARROWBAND  WAVEFORM 

The  available  input  waveform  of  interest  in  this  section  has 
the  form 

A  ( t )  cost  2  iif  t  +  ( t )  ]  ,  (13) 

X  ox 

where  f  is  the  known  center  frequency,  and  Ax(t)  and  ♦x(t)  are 
the  lowpass  amplitude  and  phase  modulations,  respectively.  The 
complex  envelope  of  this  waveform,  which  can  be  easily  extracted 
from  (13),  is 


x(t)  -  Ax(t)  expt i +x ( t ) 1  •  (14) 

We  will  allow  an  arbitrary  complex  memoryless  nonlinear 
transformation  h  of  A  (t)  and  *  (t);  that  is,  the  output  is 

X  X 

modified  complex  envelope 

y ( t )  -  h { A  ( t ) , ♦  ( t ) }  -  h{ | x ( t ) j ,  arg( x( t ) ) }  *  g{x(t)}  ,  (15) 

X  X 

where  g  is  an  arbitrary  complex  function  of  complex  argument 
x(t).  Transformation  g  need  not  be  analytic. 

The  input  x(t)  to  nonlinearity  g  is  composed  of  signal-plus- 
noise  (or  noise-alone);  thus,  we  can  express  the  signal-plus- 
noise  output  as 

y^t)  -  g{Ag(t)  exp(i$s(t)]  +  An(t)  exp[i*n(t)]}  ,  (16) 

where  A  (t)  and  *  (t)  are  the  arbitrary  input  signal  amplitude 

5  5 

and  phase  modulations,  while  An(t)  and  $n(t)  are  the  input  noise 
amplitude  and  phase  modulations,  respectively.  We  presume  a  low 
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input  signal-to-noise  ratio;  that  is, 

Ag(t)  <<  An(t)  '  {17) 

However,  there  are  no  limitations  on  the  sizes  of  phase  modula¬ 
tions  ♦_(t)  and  *  (t),  nor  on  the  signal  characteristics.  The 
joint  probability  density  function  of  the  noise  amplitude  and 
phase  modulations  is  presumed  known;  that  is,  P(An/*n)  is  given. 
(Again,  although  we  suppress  any  t  dependence  of  p,  the  following 
analysis  allows  for  nonstationary  noise  simply  by  reinstating  any 
t  dependence  in  p.) 


MEAN  OUTPUTS 

For  given  signal  amplitude  and  phase  modulations  A  (t)  and 
♦_(t),  the  complex  mean  output  from  the  nonlinearity  g  is,  from 

5 

(16), 

yJTtT  -  JJ  dAn  d*n  g{Ag(  t)exp[  i«j»s(  t)  ]+Anexp[  i<^n] }  P(An^n)-  (18) 

We  now  make  the  change  of  variables 

A  exp( i$]  -  Ag(t)  expli*s(t)J  +  An  exp[i*n]  (19) 

in  (18).  The  Jacobian  of  this  two-dimensional  transformation  is 
derived  in  appendix  A;  it  is 


9<W 

3  ( A,  ♦  ) 


_ A _ 

I A  exp( i $ ]  -  Ag(t)  expl i*g( t ) ] | 


(20) 
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At  this  point,  for  notational  convenience,  we  will  suppress 
the  t  dependence  of  A  and  $  ;  this  time  dependence  will  be 
reestablished  after  all  the  following  mathematical  manipulations 
have  been  completed.  The  use  of  (19)  and  (20)  converts  (18)  into 
the  following  exact  result  for  the  complex  mean  output 

V.  (  t )  »  IT  dA  d$  -rr - 7  rrr  A  - - T-r-r — r-r  g{A  exp(i<f>)}  X 

*1  JJ  | A  exp(i$)  -  Ag  exp(i#  )|  T#l 

x  p  ^  |  A  exp(i<|>)  -  Ag  exp(i<|»s)|,  arg{A  exp(i<|>)  -  Ag  exp(  i 4>g ) } )  .  (  21 ) 

This  expression  could  be  written  in  an  entirely  equivalent  form 
by  replacing  g{A  exp(i<fr)}  with  h{A,$};  that  is,  from  (14)  and 
(15), 

h{A,+}  «  g{A  exp(i$)}  for  all  A,$  .  (22) 

This  latter  form,  in  terms  of  h,  more  clearly  accents  that  a 
completely  arbitrary  transformation  of  A  and  <|>  is  allowed; 
however,  since  g  is  arbitrary,  the  same  is  true  of  the  form 
g{A  exp(i+)},  which  is  used  henceforth. 
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SMALL  INPUT  SIGNAL-TO-NOISE  RATIO 

We  now  make  use  of  the  low  input  signal-to-noise  ratio 
assumption,  (17),  by  expanding  (21)  through  first-order  terms  in 
the  signal  amplitude  modulation  Ag .  Since 

|1  -  e  -  i&|  -  J(1  -  e)2  +  52  -  1  -  e  , 

and 

arg( l-e-i&)~-&, 

through  linear  terms  in  real  variables  e  and  S,  then 

I A  exp(  i<fr)  -  A  exp(  i*  )  |  -  A  -  Ae  cos(i  -  <f>)  for  A  <<  A  , 

SS  5  S  S 

(23) 

As 

arg{A  exp(i$)  -  A  exp(i*  )}  ~  *  -  —  sin(*  -  4>)  for  A  <<  A  . 

5  5  nS  S 

Substitution  in  (21)  yields 

yi(t>  -  II  d*  a  -  -  ♦>  9<a  » 

S  S 

X  p(a  -  Ag  cos  (  $g  -  $),  ♦  -  sin(  ♦g  -  4>)}  .  (24) 

Define 

pl  ( A  *  ♦ )  -  g|  p(A,4>)  ,  P2  ( A '  ^ )  -  g|  P(A,*)  ,  (25) 

where  it  is  presumed  that  these  derivatives  of  p  exist.  Then  the 
term  in  (24)  involving  joint  probability  density  function  p  can 
be  expanded  as 
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p  ( A,  $ )  -  Ag  cos(*g  -  $)  p^A,^)  -  ~  sin(+s  -  <f>)  p2(A,<M  ,  (26) 


to  linear  terms  in  Ag.  Coupled  with 


a  -  a— cti(C--~  '  1  *  <r  C05(*s  -  ♦>  £orAs«R'  (27> 
s  s 


(24)  develops  into 


A 

y1(  t )  -  JJ  dA  d«|>  [l  +  j5-  cos(«j.g  -  *)J  g{A  exp(i<|>)}  x 
x  |^p  ( A ,  * )  -  Ag  cos  ( 4>s  -  <|>)  p1(A,<j>)  -  sin(  -  ♦)  p2(A,<{>)]  » 

A 

~  JJ  dA  d<fr  g{A  exp(i$)}  [p(A,$)  +  cos(+g  -  <J>)  p(A,<f>)  - 


-  A. 


As  1 

cos(<|»s  -  <f»)  P1(A,  +  )  -  —  s  i  n  (  ♦s  -  4>)  P2  ( A ,  <() )  J  ,  (28) 


through  linear  terms  in  A  .  There  is  no  presumption  about  the 
form  of  nonlinearity  g  in  these  expressions. 

There  is  a  fundamental  flaw  in  the  use  of  approximations 
(23)  and  (27)  in  integral  (21).  The  approximations  specifically 
require  that  A  >  A  ,  yet  they  are  used  in  end  result  (28)  all  the 
way  down  to  A  *  0.  The  results  in  (23)  should  be  augmented  with 


I  A  exp(  i  $  )  -  Ag  exp(i<f>g)| 
arg { A  exp(i<|>)  -  Ag  exp(i$g)} 


*5  +  n  J 


for  A  <<  A 

S 
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This  would  not  only  eliminate  the  troublesome  1/A  dependencies 
for  small  A  in  (23)-(28),  but  in  fact  convert  the  Jacobian  to  a 
linear  A  dependence  for  small  A,  a  very  marked  change. 

The  reason  we  do  not  incorporate  this  behavior  is  that  it 
would  greatly  complicate  (28),  and  the  intermediate  range, 

A  =  A  ,  would  still  not  be  covered.  What  this  means  is  that  we 

b 

can  anticipate  some  problems  with  approximation  (28)  and  further 
results  based  on  (28),  for  small  A;  in  fact,  we  must  be  willing 
to  modify  or  discard  the  1/A  dependency  in  some  cases  and  ranges, 
since  it  is  based  upon  an  invalid  approximation.  We  will  return 
to  this  point  later  and  elaborate  in  more  detail. 

The  mean  output  from  complex  nonlinearity  g,  for  noise-only, 
is  available  directly  from  exact  result  (21)  by  setting  A  =  0 : 

b 

T^Ttl  -  JJ  dA  d*  g{A  exp(  i<H  )  p(A,  $)  .  (  29  ) 
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DIFFERENCE  IN  MEAN  OUTPUTS 

The  difference  in  complex  mean  outputs  from  nonlinearity  g, 
for  signal-present  versus  signal-absent,  is  then  available  from 
(28)  and  (29)  as 

y^TtT  -  yQ( t )  -  -  Ag  JJ  dA  d<*  g{A  exp(i*)}  x 

x  [cos(<|>s  -  $)  q1  ( A,  $ )  +  sin($s  -  <*)  q2(A,*)j  ,  (30) 

where,  using  (25),  the  real  quantities 

<3l  ( A,  ♦)  -  A  ji  ,  q2(A,  +  ) 

The  approximate  result  in  (30)  is  similar  to  that  in  (7)  for 

the  lowpass  real  case  in  that  signal  amplitude  A  appears 

s 

multiplicatively  as  a  linear  factor.  However,  (30)  is  still 
complicated  by  the  appearance  of  signal  phase  *  inside  the 

b 

integrals.  If  we  expand  the  cos  and  sin  terms  in  (30),  we  find 

yx(  t)  -  yQ(  t)  -  -  Ag  (cos*s  za  +  sin<j>s  zfc)  ,  (32) 

s 

where  complex  numbers  (due  to  the  allowed  complexity  of  g) 
zg  -  JJ  dA  d$  g{ A  exp(i<|>)}  [cos*  q1(A,*>)  -  sin*»  q2(A,*>)j  , 

*b  ■  JJ  dA  d*  9>A  exp(i*)}  [sin*>  q^A,*)  +  cos<)>  q2  ( A ,  ♦ )  j  .  (33) 
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An  alternative  form  of  (32)  is  more  useful;  specifically,  the 
difference  of  mean  outputs  can  be  expressed  as 

y^Ttl  -  y0(t)  -  -  \  Asexp(i*s)  (za-izb>  -  \  Asexp(-i«^s)  (za+izb)- 

(34) 

m  -  j  Ag(t)  exp[ i ♦ s ( t ) ]  (za_izb)  ~  \  As(fc)  expl-i+g( t ) ]  (za+izb), 

where  we  have  reestablished  the  time  dependence  of  the  signal 
amplitude  and  phase  modulations  A  (t)  and  ♦  (t),  respectively. 

The  two  complex  numbers  in  (34)  can  be  written  as 

za~izb  -  JJ  dA  d<|>  g{A  exp(i<J>)}  exp(-i«|>)  [q1(A,<|»)  -  iq2  ( A,  )  ]  ,  (  35  ) 

za+izb  -  JJ  dA  d$  g{A  exp(i<f>)}  exp(+i«j>)  tq1(A,4«)  +  iq2  (A,  *)  ]  .  (  36 ) 

The  leading  term  in  (34)  contains  a  replica  of  the  input 
signal  to  the  nonlinearity  g,  namely, 

Ag(t)  exp[ i ( t ) ]  ,  (37) 

and  will  be  called  the  desired  signal  component  in  the  difference 
of  mean  outputs.  The  remaining  signal-dependent  term  in  (34), 
namely, 

Ag(t)  exp[-i«j>s(  t)  )  ,  (38) 

is  of  no  interest  since  it  has  a  distorted  phase  modulation. 

That  is,  (38)  will  not  correlate  with  the  local  reference,  since 
the  latter  has  exactly  the  same  form  (38).  Henceforth,  we  simply 
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ignore  the  extra  term  (38)  in  difference  (34).  Thus,  for  the 
desired  signal  component,  we  have 

(y]TtT  -  y^Odesired  "  "  I  As(t)  ®*P[iVt)I  (za  "  izb)  ' 


where  the  complex  number  zQ  -  i  is  given  by  (35). 

The  simplest  example  of  this  behavior  is  furnished  by  the 
nonanalytic  nonlinearity 

g{z)  -  i z | 2  , 

for  which  the  output  is 

y1(t)  -  |Ag(t)  exp[ i$s( t ) ]  +  An(t)  exp[ i*n( t ) ] | 2  » 

-  A2 ( t )  +  A  ( t )  exp[-i<fr  ( t) )  A  (t)  exp [ i ♦  ( t ) ]  + 
n  n  ns  o 

+  A  (t)  exp( i ♦  ( t ) ]  A  (t)  exp[ -i*  ( t ) ]  +  A2(t)  . 

n  ns  s  s 

Both  types  of  signal  terms,  (37)  and  (38),  are  exhibited  here 


(39) 
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VARIANCE  OF  OUTPUT 

At  the  same  time,  the  variance  of  the  output  of  the 
nonlinearity,  for  noise-alone,  is 


var(yQ( t ) ) 


y0(t)  -  yQ(t) 


2 

2 

” 

yQ(t) 

— 

yQ(t) 

t 

(40) 


where  y  (t)  is  available  from  (16)  by  setting  A  (t)  -  Os 

O  5 

yQ(t)  -  g{An(t)  exp[ i+n( t ) ] }  .  (41) 

There  follows  immediately  the  exact  result 


var (yQ( t ) ) 


g{An(t)  exp[  i<J>n(  t)  ] } 


g{An(t)  exp[ i$n( t ) ) } 


JJ  dA  d*  I g { A  exp(i+)}|2  p(A, 


♦  )  - 


dA  d*  g{A  exp (  i ♦ ) }  p(A,$) 


(42) 


where  p(A,<fr)  is  again  the  joint  probability  density  function  of 
the  noise  amplitude  and  phase  modulations. 
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OUTPUT  DEFLECTION 

We  are  now  prepared  to  define  an  output  deflection  from 
nonlinearity  g  (analogous  to  (9))  as 


J  As(t> 


[  dA  d$  g{ A  exp(i<fr)}  exp(-i$)  [q1(A,+)  -  iq2 ( A# ♦ ) ] 
[  dA  d*  g{  }  2  p ( A, $ )  -  dA  d$  g{  }  p(A,<fr)  2 

J  J  J 


(43) 

where  we  used  (39),  (35),  and  (42).  Since  (30)— (39)  are  based  on 
approximation  (28),  deflection  (43)  is  likewise  approximate. 


MAXIMUM  DEFLECTION 

We  would  like  to  maximize  this  small-signal  deflection  (43) 
at  the  nonlinearity  output,  by  choice  of  the  nonlinearity  charac¬ 
teristic  g.  However,  as  in  the  sequel  to  (9),  two  important 

observations  must  be  made.  First,  the  absolute  scale  of  g  is 

2 

obviously  immaterial  to  the  value  of  d  .  Second,  an  additive 

2 

complex  constant  to  g  does  not  affect  d  ;  this  last  property  is 
derived  in  appendix  B.  Thus,  nonlinearity  a  g{A  exp(i$)}  +  b 
gives  the  same  deflection  as  g{A  exp(i$)},  where  a  and  b  are 
arbitrary  complex  constants. 

What  this  means  is  that,  without  loss  of  generality,  we  can 
set  the  complex  nonlinearity  mean  output  for  noise-alone,  yQ(t), 
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equal  to  zero,  and  not  detract  from  the  attainable  values  of 
deflection  criterion  (43).  So,  setting  (29)  to  zero,  (43) 
becomes 


d 


2 


As(t> 

li 

dA  d*  g  (A  exp(  i  $ ) }  exp(-i<fr)  (q^A,*)  -  iq2(  A,*)] 

[2 

4  I 

J  dA  d* 

g { A  exp( i$ ) } 

2  p ( A, ♦ ) 

But  now,  since  g  is  completely  arbitrary,  by  Schwartz's 
inequality,  this  ratio  is  maximized  by  the  (approximate)  optimum 
memoryless  nonlinearity 


9m{A  exP<i*H  -  hm(A,*} 


exp(iifr)  ^q  ^  ( A ,  $  )  +  iq2(A,4>)} 
P ( A, ♦ ) 


_  exp(i»)  r  3fp(A,»))  .  3fp(A,»m 

■  p  ( A,  $ )  L  3A  l  A  J  +  1  3*1  A  JJ 


-  expU*)^  i  ln{p(  A,  ♦) }  ]  ,  (45) 


where  we  used  (22)  and  (31).  Here,  we  also  have  taken  advantage 
of  the  scaling  independence  in  order  to  supply  the  factor  -1  for 
convenience.  This  result  agrees  with  [1;  (9)]. 

The  resulting  maximum  deflection  is 


d»  •  J  As(t>  II  dA  d* 


qj_(A,*)  +  iq2  ( A,  ♦  ) 


p(A,$) 


1  .2.  .  ff  .  .  ql(A'*)  +  <?2(A'*) 

-  T  Ag  JJ  dA  d*  - puTT) -  ' 


(46) 
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where  and  q2  are  available  from  (31)  as 


_1  fP(A,») 
3$  l  A 


(47). 


Whether  the  phase  term,  q, ( A, ♦ )/p( A, $ ) ,  in  optimum  nonlinearity 
(45)  is  important  or  not  can  be  ascertained  from  (46)  by 
evaluating  it  with  and  without  the  q^/p  term  present.  Some 
limitations  of  approximations  (45)  and  (46)  concerning  the  1/A 
dependencies  are  given  in  appendix  C,  as  well  as  an  alternative 
approach. 

Substitution  of  optimum  nonlinearity  (45)  into  noise-alone 
mean  output  (29)  immediately  yields  the  conjugate  of  the  integral 
in  ( B-l ) ,  which  is  shown  to  be  identically  zero  in  (B-4).  This 
is  consistent  with  the  nonrest rictive  assumption  utilized  in 
reducing  (43)  to  (44).  It  should  also  be  noted  that  signal 
amplitude  A  (t)  appears  as  a  multiplicative  term  in  general 
deflections  (43)  and  (44);  thus,  the  optimum  nonlinearity  g  can 
be  selected,  as  in  (45),  without  regard  to  the  particular  signal 
amplitude.  It  also  allows  A  (t)  exp[i$  ( t ) ]  to  be  deterministic 
or  random,  as  the  case  may  be.  This  is  all  predicated  on  the 
small  signal  assumption  utilized  in  (22)  —  (28)  .  The  actual  output 

time  waveform  from  the  optimum  nonlinearity  g  in  (45)  is 

■'m 

obtained  by  replacing  argument  A  exp(i$)  with 
Ag ( t )  exp(i*s(t)]  +  An(t)  exp[i$n(t)J;  see  (16). 
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PHYSICAL  INTERPRETATION 

A  physical  interpretation  of  what  is  taking  place  in  this 
complex  envelope  case  is  given  in  figures  4-6.  The  noise-only 
output  yQ( t)  is  plotted  on  the  left  side  of  each  figure  as  a 
complex  point  in  the  plane,  which  moves  as  time  progresses.  The 
noise-only  mean  output  for  arbitrary  nonlinearity  g  is  indicated 
by  a  dashed  arrow  in  figure  4  to  the  complex  point  y  ( t )  given  by 
(29).  For  any  nonlinearity  g  selected,  this  is  a  known  point 
since  joint  probability  density  function  p(A,<fr)  is  known. 

When  signal  is  also  present,  the  situation  for  output  y^t) 
is  depicted  on  the  right  side  of  each  figure.  The  mean  output 
for  arbitrary  nonlinearity  g  is  indicated  by  a  dashed  arrow  in 
figure  4  to  the  complex  point  y^TtT  given  by  (21)  or  (28).  This, 
too,  is  a  known  point  for  specified  g,  A  ,  . 

when  we  choose  the  class  of  nonlinearities  g  that  have  zero- 
mean  noise-only  output  yQ(t),  as  done  in  (43)— (44),  we  are  taking 
advantage  of  knowledge  of  these  locations  and  the  situation  is 
as  shown  in  figure  5.  The  mean  location  of  complex  waveform 
yQ(t)  is  now  at  the  origin  of  coordinates  and  its  standard 
deviation  from  the  origin  is  indicated  by  aQ.  Then  the  plot  of 
y^t)  appears  on  the  right  side  of  figure  5,  where  the  dashed 
arrow  is  drawn  to  the  point  y^ ( t ) .  When  we  maximize  the 
deflection  criterion  d  in  (44),  we  are  maximizing  the  ratio  of 
the  length  of  the  arrow  on  the  right  side  to  the  standard 
deviation  aQ  on  the  left  side.  Physically,  we  are  trying  to  make 
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the  signal-present  average  distance  from  the  origin  as  large  as 
possible  relative  to  the  signal-absent  deviations  from  the 
origin . 

Finally,  figure  6  represents  the  outputs  when  the  optimum 
nonlinearity  is  scaled  and  biased  by  an  arbitrary  factor  and 
additive  constant.  Both  yQ(t)  and  y^(t)  are  similarly  scaled  and 
shifted,  but  the  maximum  deflection  is  unchanged. 


EXAMPLES 

As  an  example  of  (45)  and  (46),  suppose  the  narrowband  noise 
is  zero-mean  Gaussian;  then 


p(A,  <fr) 


2  na'_ 


exp 


n 


for  A  >  0,  | ♦ |  <n, 


(48) 


giving 


gffl{A  exp(i$)}  -  —  A  exp( i ♦ ) 

a 


(49) 


and 


m 


n 


A^t)^ 


n 


(50) 


Thus,  the  optimum  nonlinearity  in  (49)  is  linear  and  the  maximum 
deflection  is  the  signal- to-noi se  power  ratio  at  the  input  to  the 
nonlinearity.  A  more  thorough  analysis  of  this  example  is  given 
in  appendix  C. 
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By  the  arguments  given  in  the  sequel  to  (43),  we  could 
equally  well  use  nonlinearity 

§m(A  exp(  i<fr ) }  =  A  exp(  i ) 

2 

and  realize  the  same  maximum  deflection  d_  in  (50).  In  the 

m 

general  case,  we  can  always  use  (modified)  optimum  nonlinearity 

gm(A  exp(  i«j>) }  -  a  gm(A  exp(i<j>)}  +  b 

2 

instead  of  (45),  and  still  realize  maximum  deflection  dm  in  (46), 
where  complex  constants  a  and  b  can  be  chosen  for  convenience. 

The  major  difference  is  that  the  noise-only  mean  output  is  then 
b,  not  zero;  however,  since  b  is  known,  this  constitutes  no 
limitation  or  problem.  This  case  is  depicted  in  figure  6. 

As  a  second  (more  general)  example,  if  the  noise  amplitude 
and  phase  modulations  are  statistically  independent,  then 

p ( A , $ )  -  pa(A)  pb(+)  ,  (51) 

and  (45)  reduces  to 


gm{A  exp(i+)}  -  hm(A,<H 


-  exp(i<j>) 


_d 

dA 


In 


fPa(A)l 

l  A  , 


•  I  PbU) 

+  1  A  pbU) 


(  52) 


This  result  agrees  with  {1;  (10)  and  (16)).  The  maximum 
deflection,  (46),  is 
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7  *s(t> 


dA 


[Pg  (  A)  -  PgfAl/A]2 


+ 


dA 


Pa(A) 


Pb2(*n 
pb(+>  /  * 


(53) 


The  relative  importance  of  the  p£($)  term  can  be  easily 
ascertained  from  here.  The  1/A  dependencies  are  thoroughly 
discussed  in  appendix  C. 


DISCUSSION  OF  IMAGINARY  TERM 


In  general,  for  the  optimum  nonlinearity  in  (45),  the  exp(i<t>) 
factor  indicates  a  replication  of  the  phase-modulation  at  its 
input;  that  is,  from  (16), 

arg{Ag(t)  exp  [  i  4»s  ( t )  ]  +An(t)  exp[i4>n(t)]}  (54) 

is  reproduced  at  the  output  of  gm.  And  if  the  imaginary  term 
inside  the  bracket  of  (45)  were  zero,  that  is,  q2  ■  0,  this  would 
be  the  totality  of  phase  modulation  at  the  output  of  the  optimum 
nonlinearity.  Since  q2  ■  0  corresponds  to  p(A,$)  being  indepen¬ 
dent  of  <fr,  the  modification  of  the  amplitude  modulation  at  the 
nonlinearity  input  would  then  be  according  to 


-  is  ln 


fPa(A,' 


and  the  maximum  deflection  is 


(55) 
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7  As(t) 


dA 


[p^( A)  -  Pa ( A)/a] 

pTTa) 


(56) 


However,  the  presence  of  the  extra  imaginary  term  in  (45) 

means  that  additional  amplitude  and  phase  modulations  to  those 

given  in  (55)  and  (54),  respectively,  are  superposed  on  the 

output.  Whether  this  is  significant,  in  practice,  will  depend  on 

2  2 

a  quantitative  investigation  of  the  relative  sizes  of  and  q2 
in  maximum  deflection  (46). 


SIZE  OF  NEGLECTED  TERM 

When  we  expressed  the  difference  of  mean  outputs  from  nonlin¬ 
earity  g  in  the  form  (34),  we  discarded  the  second  term  as  being 
of  an  undesirable  form.  To  see  how  this  neglected  term  compares 
with  the  retained  term,  in  terms  of  magnitude,  we  need  to  compare 
| za  -  iz^l  with  | zg  +  iz^|.  For  the  optimum  nonlinearity  gm  in 
(45),  we  have,  from  (35)  and  (36), 


z  -  i  z. 

a  b 

m 

dA  d<fr 


q^  ( A,  <(>)  +  q2  (A,  *) 
p( A, ♦) 


(57) 


p 

[q. (A,  <fr)  +  iq, (A, ♦ ) 1 

za  +  izb 

m 

m 

dA  d  +  exp(i2*)  L  p(Af^2  J 

dA  d<J>  exp(  i2$ ) 


q?(A,*)  -  q2(A,*)  + 


i2  q1  (A,  4>)  q2 


(A,  ♦) 


p(  A,  <(>) 


.  (58) 


Thus,  the  exp(i2ij>)  term  chops  up  the  <f>  integral,  since  2<C  ranges 


33 


TR  8611 


2 

over  4ji,  leading  to  a  small  value  for  (58).  in  addition,  the 
2 

and  q2  terms  cancel  each  other  in  (58),  whereas  they  add  in  (57). 
It  can  also  be  observed  that  (57)  is  identical  with  the  maximum 
deflection  (46),  except  for  factor  A  (t)/4.  Some  alternative 

o 

forms  to  (57)  and  (58)  in  rectangular  coordinates  are  given  in 
appendix  D. 

Of  course,  in  all  cases, 


* 

q,  ( A ,  $  )  +  iq~  ( A ,  <(> ) 

za  +  izb 

m  * 

V 

dA  d$  |  exp(  i2<j> )  |  - 

P(A,<J>) 

however,  it  is  expected  that  we  will  have 


(59) 


z  +  iz. 

<<  z  iz. 

a  b 

m  a  b 

(60) 


in  most  practical  cases.  As  an  example,  the  Gaussian  noise 
considered  in  (48)— (50)  yields 


z 

a 


12, 


m 


_2 

2 

<T 


t 


a 


+  12, 


m 


+®  n 

J  dA  J  d+ 

0  -it 


exp( i2$ ) 


0.  (61) 


Thus,  neglecting  the  second  term  in  (34)  is  justified,  both  in 
terms  of  physical  interpretation  and  in  terms  of  magnitude  of 
contribution . 
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OPTIMUM  NONLINEARITY  FOR  PHASE  CHANGES 

It  is  hard  to  conceive  of  an  independent  physical  narrowband 
noise  process  for  which  the  phase  $n(t)  would  not  be  uniformly 
distributed  over  a  2n  interval.  In  that  case,  (51)  is  relevant, 
with  ( <#► )  constant  of  value  (2n)~*.  Then  the  second  term  in 
optimum  nonlinearity  (52)  is  absent,  as  is  the  additive  term  in 
(53);  see  also  (55)  and  (56). 

NONLINEAR  PROCESSING 

In  this  situation,  it  may  be  advantageous  to  resort  to 
additional  processing  of  the  phase  changes  between  adjacent  time 
samples  of  input  x(t);  regular  phase  changes  would  occur  for  a 
frequency-shifted  narrowband  process,  such  as  encountered  in  FSK 
communication.  In  particular,  we  consider  nonlinear  processing 
of  adjacent  time  samples  of  the  received  waveform,  namely, 

Ax(t),  *x(t),  Ax(t-A),  *x(t-A),  (62) 

where  A  is  the  time  between  samples;  see  also  (13)  and  (14). 

Thus,  the  output  of  the  nonlinearity  is  generalized  from  (15)  to 

y  ( t )  -  h{Ax(t),  *XU),  Ax(t-A),  *x(t-A)}  ,  (63) 

where  h  is  an  arbitrary  complex  nonlinear  transformation  of  four 
real  variables. 
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INPUT  NOISE  STATISTICS 

The  required  statistical  information  about  the  input  noise 
process  is  now  the  joint  probability  density  function  of  noise 
quantities 


An(t)'  *n(t)'  Vt-M'  Vt-A)  ‘  (64) 

We  denote  these  random  variables  by 


(65) 


respectively,  and  presume  that  their  joint  probability  density 
function  has  the  form 


Pa(V  Pb<V  Pa(V  Pc(*n  ~  V 


(66) 


That  is,  all  the  random  variables  (65)  are  statistically 
independent  except  that  <frn  »  $n(t)  depends  on  $n  -  $n(t-A);  thus, 
probability  density  function  pc  can  be  expected  to  peak  at  a 
point(s)  related  to  the  frequency  shift(s)  of  the  noise  carrier. 
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MEAN  OUTPUT 

The  mean  output  from  the  general  nonlinearity,  for  signal 
present,  is 

y ^  ( t )  -  h{Ax(t),  <frxU),  Ax(t-A),  +x(  t-A) }  - 

'  JTJT  d*n  d*n  *>»<V  VV  P.<V  Pc<V*n>  * 

X  h{|An  exp(i*n)  +  As  exp(i*g)|,  arg{An  exp(i$n)  +  Ag  exp(i<|>s)}, 

|An  exp(i?n)  +  Ag  exp(i$g)|,  arg{AR  exp(i*n)  +  Ag  exp( i *g ) } } , ( 67 ) 

where  we  suppressed  the  time  dependence  of  the  signal  terms  (for 
now)  by  using  the  notation 

As  -  As(t),  -  ♦g(t),  Ag  -  Ag(t-A),  *s  -  ♦g(t-A)  .  (68) 

Now  make  the  changes  of  variables  (using  appendix  A) 

A  exp(i<fr)  -  An  exp(i4»n)  +  Ag  exp(i<J>g)  , 

A  exp(i?)  -  A  exp(i$  )  +  A_  exp(i?  )  ,  (69) 

n  ns  s 

to  obtain  mean  output 

TTTtT  -  [|[[  dA  d^  dA  d?  Pa(/u)  Pb(0)  * 

J  J  J  J  fj  fj 

X  P An)  p^(e-9)  h{A,*,A,*}  ,  (70) 

a  C 
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where 

u  -  //( A,  $ )  -  |  A  exp(  i$ )  -  Ag  exp(i<|>s)|  , 

~jj  -  p(A,J)  -  | A  exp(i?)  -  Ag  exp(i?g)|  , 

9  -  9(A,$)  -  arg{A  exp(i<|>)  -  A  exp(i<|>  )}  , 

s  s 

e  -  9(  A,?)  -  arg{A  exp(i$)  -  A  exp(i<j>  )}  .  (71) 

S  5 

This  result,  (70),  is  exact. 

SMALL  INPUT  SIGNAL-TO-NOISE  RATIO 

For  small  signal-to-noise  ratios,  we  can  now  expand  the 

quantities  in  (71)  in  power  series  in  A  and  A  through  linear 

5  5 

terms.  Reference  to  (23)  yields 

u  ~  A  -  A_  cost  ♦_-<*>) 

5  5 

p  -  A  -  Ag  COS(?s  -  $) 

As 

9  ”  +  “  sin<  +S  “  ♦) 

_  _  A  _ 

6  -  ♦  -  ~  sin(  *  -  <>) 

T  5 
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-  ♦)  , 


A  -  A  C0S(4>  -  ♦ )  ~  1  +  A  C0SUS 

S  5 


cos(«j»s  -  ♦)  , 


where  we  used  (72)  and  (27).  Substitution  in  (70)  gives 


(73) 


approximation 


yx(t)  - 


*  pa(A  - 


-  -  r  Rs  i  r  as  -  - 1 

dA  d+  dA  d<j>  1  +  r—  cos(*  -  $)  1  +  —  cos(*  -  $)  x 

A  5  T  5 

.  .  A 


A_  cos 
s 


(<fr_  -  ♦)]  pK  ♦  -  ~  sin ( *  -  ♦) 

s  )  j  s 


\ 

pa(A  - 

> 


A  cost  <)>  - 
s  s 


.  f  _  A  A  _  _  _ 

-♦)J  Pc  ♦  ~  sin<+s  -♦)+!“  sin(*s  -  +  )  h{A,*,A,*}.  (74) 

k  A  > 


Again,  however,  as  noted  below  (28),  the  1/A  and  1/A  dependencies 
are  incorrect  for  small  A  or  A;  we  must  be  prepared  to  modify  or 
discard  the  1/A  dependency  in  some  cases  where  infinities  in 
behavior  arise.  The  discussion  in  appendix  C  is  again  very 
relevant . 

Now  we  could  expand  mean  output  (74)  through  linear  terms  in 

A  and  A  .  However,  since  we  have  only  one  nonlinearity  h{  }  to 

choose,  we  will  not  be  able  to  simultaneously  maximize  the 

coefficients  of  both  A„  and  A„ .  Instead,  we  concentrate  solely 

s  s 

on  A  -  A  (t)  and  maximize  its  coefficient;  this  is  consistent 

5  5 

with  the  observation  that  the  output  of  nonlinearity  (63)  at  time 


t-A  will  already  have  maximized  the  coefficient  of  A  -  A  (t-k) 

5  5 
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when  i_t  was  the  current  output. 


Then,  to  linear  terms  in  A  , 

s 


(74)  becomes 


y^t)  ~  JJJJ  dA  d*  dA  d*  |pa(A)  pb(<fr)  Pa(A)  Pc(4>  -  ♦)  + 

As  - 

+  £=■  COS(+s  -  *)  Pa(A)  Pb(<(>)  Pa  ( A )  Pc(<fr  -  +)  - 
-  Ag  cos ( -  ♦)  Pa<A)  Pb(  +  )  Pa(A)  pc(*  "  ♦)  - 
-  ^  sin(*g  -  ♦)  pa(A)  pb(?)  pa(A)  p£(*  -  ?)]  h{A,*,A,*}  .  (75) 


The  leading  term  in  (75)  is  yQ(t),  the  noise-only  mean 

output.  The  remaining  terms  contain  A  linearly  and  a 

s 

combination  of  exp(i*  )  and  exp(-i*  )  terms.  As  explained  in 

s  s 

(34)  et  seq. ,  the  desired  signal  term  is  that  containing  just 
exp(i$  ).  It  is,  from  (75), 

5 

j  As  exp(i*s)  JJJJ  dA  d$  dA  d?  h{A,*,A,?J  exp(-i*)  pg(A)  pfa(?)  x 
fPa(A)  -  -  Pa(A)  _  1 

x  | — ^ —  pc(*  -  ♦)  -  Pa ( A )  pcU  -  ♦)  +  i  — ^ —  P£ (♦-♦)[•  (76> 
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VARIANCE  OF  OUTPUT 

At  the  same  time,  the  variance  of  the  nonlinearity  output 
(63)  for  noise-only  is  exactly 


var (yQ( t ) ) 


dAd+dAd* 


h{A, 


Pa(A)  pb(*J  pa(A)  Pc(*“<,,) 

(77) 


where  we  have  set  yQ(t)  -  0  as  usual.  The  deflection  is  equal 
to  the  magnitude-squared  value  of  (76)  divided  by  (77).  This 
deflection  is  maximized  by  the  optimum  nonlinearity 


hm(A,+,A.») 


exp( i$) 


1 

A 


P4<A> 

Pa(A) 


-  exp(i+) 


r?a(A) 


+  1  x 


1 

A  PcU-?>. 

P'  (  ♦-♦)* 

Pc( ♦-♦) J 


(78) 


where  we  have  canceled  out  common  terms  involving  p  (A)  and 

d 

pb($).  We  must  again  take  note  that  (78)  is  only  an 
approximation  and  is  not  accurate  for  small  A. 
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OPTIMUM  NONLINEARITY 


Nonlinearity  (78)  is  identical  to  (52)  except  for  the 
replacement  of  p^f*)  by  pc(t-J);  this  agrees  with  the  comment  in 
[1;  second  paragraph  under  (10)  J.  Thus,  the  optimum  nonlinearity 
hm  is  independent  of  amplitude  variable  A  and  depends  only  on 
difference,  ♦-$,  of  phase  variables,  except  for  leading  factor 
exp(i$),  which  reproduces  the  phase  of  the  input;  see  the  second 
argument  4>x ( t )  in  (63).  In  order  to  employ  (78),  the  probability 
density  function  p^  of  noise  amplitude,  and  the  probability 
density  function  pc  of  noise  phase  changes  between  samples,  must 
be  determined. 

If  we  define  auxiliary  functions 


ha{A) 


_d 

dA 


In 


VA)1 


hc{9} 


Pc(0) 


9 


(79) 


then  (78)  can  be  expressed  as 

hm{A,*,A,?}  -  exp(  i«)  [ha(A}  +  i  i  hcU-?}]  ,  (80) 

and  the  optimum  nonlinearity  output  is,  by  use  of  (63), 
explicitly 


y( t)  -  exp( i$x( t)  ] 


ha{Ax(t)}  +  1 


hc{*x(t)  -  ♦x(t-A)} 


Ax(t) 


(81) 


All  of  these  results  are  predicated  on  the  particular  model  of 
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noise  statistics  as  given  by  (66).  Another  model  for  the  noise 
joint  probability  density  function  would  lead  to  a  different 
optimum  nonlinearity. 

When  the  optimum  nonlinearity,  (80),  is  substituted  into  the 
deflection,  which  is  the  magnitude-squared  value  of  (76)  divided 
by  variance  (77),  the  maximum  deflection  is  found  to  be 

dm  -  T  As(t>  [  J  dA  Pa(A)  ha!A>  + 

+  J  dA  a  2  J  d9  pc(0)  h^ { ©> J  .  (82) 

This  quantity  depends  only  on  the  probability  density  functions 

2 

p,,  and  p  ;  see  (64)  —  (66)  and  (79).  The  presence  of  the  p  (A)/A 
term  has  been  discussed  earlier  and  is  not  valid  for  small  A;  see 
also  appendix  C. 
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EXAMPLE 


Suppose  that  probability  density  functions 


Pa(A)  -  —  exp 
a 

a 


'-a2' 


<2a2) 

a 


for  A  >  0  , 


pc(9)  -  (2nffc)  **  exp 
Then  (79)  yields 


/  2  ' 
-0 


Ua2  ) 


for  all  0 


(83) 


ha{A}  *  ^2  for  A  >  0  '  hc{0J  “  ' 

ffa  ac 


(84) 


and  optimum  nonlinearity  (80)  becomes 


hm{A,  ♦ ,  A ,  *}  -  exp(i<j>) 


+  i  1  ±jz  .j 
,2  1  A  2 

L«T_  CT 


(85) 


The  maximum  deflection  follows  from  (82)  as 


m 


A2 ( t )/2  A2 ( t )  +" 

■  -  -f  — 5 


r  dA  A_ 

J  &2  2 


exp 


4  a  -A-  a 

c  0  a 


-A 


{2a2) 

a 


(86) 


However,  the  last  integral  on  A  does  not  converge  at  A  *  0;  this 

is  an  example  where  the  inadequacies  of  the  small-signal 

approximations  in  (72)  and  (73)  cannot  be  ignored,  and  (86)  is 

2 

useless.  The  1/A  dependency  in  (85)  and  the  1/A  term  in  (86) 
are  incorrect  for  small  A  and  must  be  eliminated  in  that  range. 
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SUMMARY 

The  transformation  of  coordinates  in  (19)  et  seq.  was 
performed  so  that  the  series  expansion  of  ( t )  could  be  done  in 
terms  of  derivatives  of  noise  joint  probability  density  function 
p,  rather  than  derivatives  of  nonlinearity  g.  This  allows  g  to 
be  discontinuous,  but  presumes  that  probability  density  function 
p  is  differentiable.  An  alternative  approach  based  upon  an 
analytic  transformation  g  is  given  in  (E-20)  et  seq. 

The  deflection  criterion  has  been  based  upon  a  difference  of 
complex  mean  outputs  for  arbitrary  signal  waveform,  as  given  by 
(30).  This  philosophy  has  been  explained  in  figure  5;  it  takes 
full  advantage  of  the  fact  that  noise-only  mean  output  yQ(t)  is  a 
known  complex  quantity  and  can  be  subtracted  out.  Equivalently, 
restricting  the  nonlinear  transformation  to  the  class  with  zero- 
mean  noise-only  outputs  does  not  detract  from  the  attainable 
deflection  values. 

Even  for  small  input  signal  amplitudes,  the  difference  in 
mean  outputs,  (34),  contains  a  spurious  term  in  addition  to  the 
desirable  term,  for  a  general  nonlinearity  g.  We  have  chosen  to 
ignore  the  undesired  term  and  to  concentrate  on  maximization  of 
the  desired  one.  After  pursuing  this  approach,  we  returned  to  a 
quantitative  measure  of  the  size  of  the  undesired  term  and  found 
that  it  was  generally  quite  small;  see  (57)  —  (61)  .  Thus,  our 
approach  was  confirmed  to  be  a  consistent  one.  An  alternative 
viewpoint  is  given  in  appendix  E,  where  it  is  shown  that 
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deliberate  suppression  of  this  spurious  term  causes  a  degradation 
in  the  maximum  deflection  attainable. 

In  equations  (45),  (52),  (78),  and  (80),  there  is  a  1/A  term 

in  the  imaginary  part  of  the  "optimum"  nonlinearity.  This  would 

appear  to  indicate  that  the  imaginary  component  is  very  important 
for  small  inputs;  see  (81)  for  example.  However,  we  have  then 
violated  the  assumptions  under  which  these  results  were  derived, 
such  as  in  (23),  (26),  (27),  (72),  (73),  and  (75).  For  example, 

(23)  presumes  that  A  is  much  larger  than  Ag.  What  this  means  is 

that  the  true  optimum  nonlinearity  does  not  really  have  a  1/A 
dependence  for  small  A;  however,  we  do  not  know  what  the  exact 
dependence  is  for  small  A,  because  our  presumptions  preclude 
investigation  in  that  region.  In  practice,  this  means  that,  for 
small  inputs,  we  must  somehow  limit  the  size  of  the  imaginary 
part  of  the  nonlinearity  output,  but  the  exact  transition  value 
and  behavior  is  unknown.  A  discussion  of  this  problem  is  pre¬ 
sented  in  appendix  C,  along  with  an  example  of  its  application 
and  illustration  of  the  basic  principles. 
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APPENDIX  A.  JACOBIAN  OF  TRANSFORMATION 

Suppose  we  want  to  make  the  two-dimensional  transformation 
between  polar  coordinates  r,9  and  according  to 


r  exp(iG)  -  p  exp(i$)  +  a  exp(ib)  , 


( A— 1 ) 


where  a  and  b  are  arbitrary  real  constants.  The  Jacobian  of  this 
transformation  is 


3(r,8) 

3(  P,<fr) 


3r 

3r 

3  P 

3 

30 

30 

3  P 

3* 

( A- 2  ) 


From  ( A— 1 ) ,  there  follows  directly 


9  r  3@ 

exp( i9)  +  r  i  exp(i0)  —  *  exp(i$)  , 


exp(  i  0 )  +  r  i  exp(i0)  ||  ■  p  i  exp(i<M 


( A—  3  ) 


Equating  real  and  imaginary  parts  of  these  two  equations,  we  have 


-  cos ( $—0 )  ,  r  ||  -  sin ( $-0)  , 


a  r  a  A 

m  -  p  sin( $-0)  ,  r  —  «  p  cos ( $-9 )  • 


( A- 4  ) 


Substituting  in  (A-2),  there  follows  the  desired  result 
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3(  C/9)  m  £.  m  _ £ _  , 

3 ( p / ♦ )  r  |p  exp(i$)  +  a  exp(ib)| 

_  _ 2 _ 

(p^  +  a^  +  2ap  cos ( 4»— b ) ) ** 


( A- 5 ) 


where  we  used  (A-l). 

If  there  were  a  need  to  solve  for  the  individual  terms  in 
(A-2),  they  can  be  obtained  from  (A-4),  by  using  the  real  and 
imaginary  parts  of  (A-l)  to  eliminate  cos0  and  sine,  with  the  end 
results 


wi  th 


r 


3_r 
3  p 


3r 

3<j> 


30 
3  P 


39 
3  $ 


^■[p  +  a  cos ( <t»-b)  j 

-  ^  sin(*-b)  , 

sin(  <j>-b)  , 
r 

^[p  +  a  cos  ( 4>-b )  j 

a^  +  2a p  cos ( $-b ) ) 


r 


H 


( A-6  ) 


( A- 7  ) 
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APPENDIX  B.  INDEPENDENCE  OF  ADDITIVE  CONSTANT 

We  will  show  here  that  the  deflection  (43)  is  unchanged  if 
g{A  exp(i<M}  is  replaced  by  g{A  exp(i<J>)}  +  b  ,  where  b  is  a 
complex  constant.  This  is  a  simple  exercise  for  the  denominator 
of  (43),  as  a  direct  substitution  and  expansion  immediately 
reveals  that  b  cancels  out  everywhere. 

For  the  numerator  of  (43),  we  have  an  additive  term  (inside 
the  magnitude-squared)  of  value 

b  JJ  dA  d«  «P<-1*)[a  -  i  4(Eix"4i)]  •  (B~1> 

However,  integration  by  parts  yields* 

I dA  a  -  - 1 dA  ib-2> 

1 1  ** 
as  well  as 

J  d*  exp(-i<f»)  l~^  )  »  i  J  d<j»  exp(-i<|>)  p  ~  ■■  .  (  B—  3  ) 

Substitution  of  these  two  results  in  (B-l)  yields 
b  £  J  d<)>  exp(-i<j>)  (-1)  J  dA  ^  -  i  J  dA  i  J  d<{>  exp  ( —  i  ^  j 

(  B-4  ) 

which  is  identically  zero.  Thus,  the  additive  term  dependent  on 
b  is  zero. 

*Result  ( B— 2 )  is  true  if  p(0,<|>)  -  0. 

★  * 

The  2n  periodicity  of  p(A,$)  in  is  utilized  in  getting  ( B—  3 )  . 
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APPENDIX  C.  BEHAVIOR  OF  OPTIMUM  NONLINEARITY 

Some  problems  with  the  approximations  utilized  in  (23)— (27) , 

in  order  to  simplify  the  mean  output  y^(t),  were  pointed  out  in 

the  sequel  to  (28)  and  were  manifested  in  the  example  in  (53)  by 

means  of  the  1/A  dependencies  for  small  A.  To  circumvent  these 

limitations,  we  will  adopt  the  procedure  used  just  after  figure  3 

for  the  lowpass  case,  namely,  investigation  of  the  exact 

deflection  and  corresponding  optimum  nonlinearity  with  knowledge 

of  signal  amplitude  A  (t)  and  phase  *  <t).  Again,  although 

s  s 

physically  unrealistic,  this  approach  is  informative  and  does 
furnish  an  absolute  upper  bound  on  performance. 

The  starting  point  is  the  exact  result  (21)  for  the  non¬ 
linearity  mean  output, 

Yx(t)  -  JJ  dA  d$  g { A  exp( i$) }  p(|z|,  arg(z))  ,  (C-l) 

where  (dropping  explicit  signal  t  dependence) 

z  «  A  exp(i$)  -  A  exp ( i *  ) .  (C-2) 

5  5 

The  noise-only  mean  output  is  obtained  by  setting  A  »  0: 

5 

*o(t)  ■  II  dA  d*  9<A  exp(i$)l  p(A,<j>)  .  (C-3) 

The  variance  of  yQ(t)  is  given  by  (42). 

We  now  define  exact  deflection 
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d2<w 


yx(t)  -  yQ(t) 
var (yQ( t ) ) 


( C-4 ) 


where  the  dependence  on  signal  parameters  is  made  explicit. 
Since  the  absolute  scale  of  nonlinearity  g  and  an  additive 
constant  to  g  do  not  affect  the  deflection,  we  can  simplify 
(C-4)  to 


d2<W 


I 

J  dA  d$ 

g{A  exp(  i$) ) 

p(  |  z  |  ,arg(z)  )  -  p(A,$)] 

2 

I 

J  dA  d$ 

g{A  exp( i ♦ ) } 

2  p(A,*) 

(  C-5 ) 


By  Schwartz's  inequality,  the  optimum  nonlinearity  (with  no 

approximations,  but  with  assumed  knowledge  of  A  and  *  )  is 

s  s 


9e(A,+;As,*s) 


A  P ( Izl ,  acq(z) ) 
I  z  I  P  ( A ,  ♦  ) 


(  C-6  ) 


where  z  is  given  by  (C-2).  The  corresponding  maximum  deflection 
follows  from  (C-5)  as 


de(As'<*’s)  "  JJ  dA  d*  [jzT  ar9(z))  "  p(  A,  ♦ )  j  P  ( A ,  ♦ ) 


JI 


dA  d$ 


A2  p2 (|z|,  arq( z ) )  _  . 

|  z | 2  P(A'*> 


( C— 7  ) 


From  ( C-2 ) ,  since 


1*1  -  [*2  ♦  As 


2  A  A 

S 


cos(  <j>s 


( C-8  ) 
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it  follows  that 


|  z  ]  ~  Ag  as  A  ->  0+  (if  Ag  *  0)  ( C-9 ) 

and,  therefore,  exact  optimum  nonlinearity  gg  in  (C-6)  has  no  1/A 
dependency  for  small  A  (unless  probability  density  function 
p( A, $ )  approaches  zero  rapidly  for  small  A),  but  in  fact  has  a 
linear  dependence  on  A.  That  is, 

A  P< 

-  FTX7T)  - 1  as  A  -»  0+  .  (C-10) 

_2 

Similarly,  the  integrand  of  maximum  deflection  dg  in  (C-7)  has  no 

2  2 
1/A  dependence,  but  in  fact,  an  A  dependence  for  small  A: 


P  <AS'+S+Il) 


p(A, ♦) 


as  A  ->  0+ 


(C-ll) 


These  are  marked  differences  in  behavior  from  the  approximate 
results  of  (45)-(47). 

It  should  also  be  noted  that  optimum  nonlinearity  gg  in  (C-6) 

is  real.  (More  precisely,  one  of  the  possible  optimum  non- 

linearities  is  real  since  complex  multiplicative  constants  can  be 

dropped. )  The  reason  this  disagrees  with  the  complex  solution  in 

(45)  is  that  A  and  *  are  presumed  known  in  (C-6).  When  <J>  is 
s  s  s 

unknown,  then  even  if  (C-6)  is  developed  in  a  power  series  in  A  , 

s 

it  is  not  possible  to  extract  a  nonlinearity  that  is  independent 
of  4  ;  this  information  is  too  deeply  embedded  in  optimum  form 
(C-6).  Thus,  (C-6)  should  only  be  regarded  as  a  guide  to  good 
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processing,  especially  for  small-  A,  but  otherwise  it  is  not 
overly  useful.  The  corresponding  maximum  deflection  in  (C-7)  is 
probably  more  useful  since  it  furnishes  an  absolute  upper  bound 
on  performance  for  any  nonlinearity.  If  an  approximate  result, 
like  (46)  or  (50)  or  (53),  outperforms  (C-7),  it  is  in  error  and 
must  be  modified  or  discarded.  The  apparent  infinity  in  (53)  at 
A  -  0,  for  example,  is  conspicuously  wrong;  reference  to  (C-ll) 
indicates  that  the  true  near-origin  behavior  is  significantly 
different. 

The  philosophy  in  this  appendix  is  very  different  from  that 
utilized  in  (34)— (39).  There,  a  desired  type  of  signal  term  was 
identified  up  front,  while  the  nonlinearity  characteristic  g  was 
still  arbitrary;  then,  that  particular  type  of  term  was  maximized 
by  choice  of  g.  Here,  the  entire  nonlinearity  output  difference 
of  means  was  maximized  without  any  type  of  term  being  designated 
as  desired.  Thus,  we  should  expect  to  be  able  to  realize  a 
larger  deflection  in  this  latter  case  since  no  terms  have  been 
suppressed  or  ignored.  The  only  problem  with  this  approach  is 
that,  after  the  maximization,  it  is  not  generally  possible  to 
extract  a  meaningful  nonlinear  device  that  is  independent  of  the 
input  signal  values  of  amplitude  and  phase. 

An  example  to  illustrate  these  points  is  furnished  by 
Gaussian  narrowband  noise  as  in  (48): 


p  ( A ,  $ ) 


_A _ 

2nal 

n 


for  A  >  0,  |<H  <n. 


( C-12  ) 
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Then,  (C-6)  and  (C-8)  immediately  yield  optimum  nonlinearity 


ge(A,*;As,*s) 


COS($g  -  ♦) 


( C-13 ) 


For  small  A  ,  this  behaves  according  to 
s 


ge(A,*;Ag/*s) - cos ( $g  -  ♦)  as  As  ■>  0  . 


( C-14 ) 


Even  though  there  is  a  linear  term  in  A  ,  which  could  be  factored 

s 

a 

out,  the  remaining  nonlinearity,  namely  — j  cos(+g  -  <fr),  depends 

ffn 

on  +s.  It  is  now  too  late  to  express 


T"  cos(*s  -  *)  m 


— ~^A  exp(-i$)  Ag  exp(i$g)  +  A  exp(i<M  Ag  exp(-i<f>s)j  (C-15) 


and  to  drop  the  A  exp(-i*  )  term  as  being  undesired  since  this 
component  has  been  an  integral  part  of  the  maximization  of 
deflection  (C-5).  In  fact,  if  we  drop  that  term  in  (C-15),  we 
are  left  with  nonlinearity 


A  exp(  -i  $ )  — r-  exp(  i  $g  ) 
2  <j 

n 


( C— 1 6  ) 


which  can  be  modified  to  A  exp(-i<fr)  since  complex  multiplicative 
factors  on  the  nonlinearity  are  irrelevant.  However,  A  exp(-i<J>) 
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manifestly  has  the  wrong  phase  behavior;  see  (49).  Thus,  this 
series  of  (late)  approximations  and  replacements  can  lead  to  a 
nonsense  processor  and  must  be  avoided. 

The  maximum  deflection  for  this  example  is  obtained  by 
substituting  (C-12)  in  (C-7): 


where  we  used  [3;  6.631  4].  Observe  that  this  quantity  is 
independent  of  signal  phase  ♦  .  For  small  input  signal-to-noise 
ratio,  this  becomes 


de'W 


as  —  0 

2 

ffn  n 


( C-18 ) 


This  latter  approximation  is  twice  as  large  as  (50)  and  is  due  to 
the  fact  that,  here,  we  have  retained  all  the  signal  terms  at  the 
nonlinearity  output,  whereas  the  method  leading  to  (50)  discarded 
one  of  the  two  possible  terms.  See  the  discussion  immediately 
after  ( C-ll ) . 

For  some  purposes,  it  may  be  more  useful  to  express  the  above 
relations  in  terms  of  the  joint  probability  density  function  of 
the  in-phase  and  quadrature  components  of  the  narrowband  noise 
rather  than  the  amplitude  and  phase.  Thus,  if  we  let  w(u,v)  be 
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the  joint  probability  density  function  of 

un  +  ivn  -  An  exp(i^n)  ,  ( C-19 ) 

then  the  joint  probability  density  function  p  of  amplitude  and 
phase  is  given  by 

p(A,$)  «  A  w( A  cos$,  A  sin<fr)  .  (C-20) 
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APPENDIX  D.  ALTERNATIVE  FORMS  IN  RECTANGULAR  COORDINATES 

In  (C-19)  and  (C-20),  the  joint  probability  density  function 
w(u,v)  of  the  in-phase  and  quadrature  components  of  the  input 
noise , 

un  +  ivn  -  An  exp(i*n)  ,  (D-l) 

was  introduced;  it  is  related  to  the  joint  probability  density 
function  p  of  amplitude  and  phase  by 

p(A,*)  -  A  w(A  cos*,  A  sin*)  .  (D-2) 

When  we  employ  this  result  in  (31),  there  follows 

q^A,*)  *>  A[  cost  w1(A  cos*,  A  sin*)  +  sin*  w2(a  cos*,  A  sin*)]  , 

(D-3) 

q2 ( A, * )  -  A(-sin*  w1(A  cos*,  A  sin*)  +  cos*  w2(A  cos*,  A  sin*)]  , 

and  therefore 

q1(A,*)  +  iq2 ( A, * )  -  A  exp(-i*)  W(A  cos*,  A  sin*)  , 
q^A,*)  -  iq2  ( A,  * )  -  A  exp(i*)  W*(A  cos*,  A  sin*)  ,  (D-4) 

where 

\ 

3  3 

W ( u , v )  m  w1(u,v)  +  iw2(u,v)  -  JJJ  +  w(u,v)  .  (D-5) 

/ 

When  (D-4)  is  employed  in  (35)  and  (36),  there  follows 
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za  -  iz^  ■  JJ  dA  d$  A  g{A  exp(i$)}  W*(A  cos$,  A  sin$) 


JI 


du  dv  g{u  +  iv}  W  (u,v) 


(D-6) 


and 


zg  +  iz^  -  JJ  dA  d$  A  g{A  exp(i<fr)}  W(A  cos$,  A  sin<j>) 


JJ  du  dv  g{u  +  iv}  W(u,v) 


(D-7) 


When  the  optimum  nonlinearity,  (45),  is  expressed  in  the 
notation  of  (D-2)-(D-5),  we  have 


gm{A  exp(i4>)} 


W ( A  cos4>,  A  sin£2 
w(  A  cos*,  A  sin<fr) 


(D-8) 


or 


gm{u  +  iv} 


W(u, v) 
w(u, v) 


( D-9 ) 


When  this  is  utilized  in  (D-6)  and  (D-7),  the  following 
alternatives  to  (57)-(59)  result: 


(2a~Ub)m  -  '  II  du  dv  *  -  JJ  du  dv  — 


w2(u,v)  +  w2 ( u , v ) 


w(u, v) 


(  \  rr  w2(u  v)  rr  [w,(u,v)  +  iw 2(u,v)l 

(v‘*b).  -  -  JJ du  dv  Urtr1  •  -  JJ du  dv  ^ 5 — 1 


w(u,v) 


-JJ 


du  dv 


2  2 

w1(u,v)  -  w2(u,v)  +  i 2  w1(u,v)  w2(u,v! 

w  (  U , V )  ™~  "  ~ 


( D— 1 0  ) 
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As  an  example  of  these  results,  suppose  that  joint 
probability  density  function 

w(u,v)  -  f (u2  +  v2);  that  is,  p(A,$)  -  A  f(A2)  .  (D-ll) 

The  noise  joint  probability  density  function  is  independent  of 
angle.  Then 

w^(u,v)  -  2  u  f'(u2  +  v2)  , 

W2<u,v)  -  2  v  f'(u2  +  v2)  ,  (D-12) 

and  (D-10)  yields 


Example  (D-ll)  is  a  generalization  of  Gaussian  probability 
density  function  (48)  and  (D-14)  generalizes  (61). 
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APPENDIX  E.  CONSTRAINED  MAXIMIZATION  OF  DEFLECTION 

When  the  difference  of  mean  outputs  was  expanded  through 

linear  terms  in  signal  amplitude  A  (t),  the  end  result  for 

s 

arbitrary  nonlinearity  g  was  (34): 

Y1 ( t T  -  yQ( t )  -  -  |  Ag(t)  exp[i+8(t)]  (zg  -  izfa)  - 

-  j  Ag(t)  exp[-i$s(t)]  (za  +  izfa)  .  (E-l) 

At  that  time,  we  ignored  the  second  term  as  being  of  no  interest 
and  maximized  the  first  (desired)  term;  see  (39)  and  (43).  Then, 
we  later  returned  to  investigate  the  relative  sizes  of  these 
terms  in  (57)— (61)  and  appendix  D. 

Here,  we  adopt  a  different  viewpoint:  we  force  the  second 
term  in  (E-l)  to  be  zero  and  then  we  maximize  the  magnitude  of 
the  first  term  by  choice  of  nonlinearity  g.  More  precisely,  we 
maximize  deflection  (43),  subject  to  integral  constraint 

JJ  du  dv  g{u  +  iv}  W(u,v)  -  0  ;  (E-2) 

this  last  equation  comes  from  (D-7)  and  (D-5). 

The  first  point  to  observe  is  that  the  absolute  scale  of  g 
does  not  affect  (43)  or  (E-2).  The  second  is  that  the  same 
independence  is  true  for  an  additive  complex  constant,  b,  to  g. 
This  was  proven  in  appendix  B  for  (43)  and  follows  for  (E-2) 
since 
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II 


du  dv  b  W(u,v) 


b  II  du  dv  (t;  +  1  87)u(u'v)  - 


-  b  J  dv  J  du  7j~"W ( u ,  v )  +  ib  J  du  J  dv  y^w(u,v)  ■  0  ,  (E-3) 
where  we  used  (D-5)  and  the  facts  that 


I 


du  j^w(u,v) 


W ( U / V )  +  c1(v) 


u-+« 


Ju—® 


I 


dy  ^w(u,v) 


w(u,v)  +  c  2 ( u ) 


v«+® 


ya-o 


(  E-4 ) 


What  this  means  is  that,  without  loss  of  generality,  we  can 
set  the  complex  nonlinearity  mean  output  for  noise-alone,  yQ(t), 
equal  to  zero.  This  results  in  deflection  (44),  which  can  be 
expressed  in  the  form 


d 


2 


L 

*  * 
du  dv  g{u  +  iv}  W  (u,v) 

2 

* 

du  dv 

g{u  +  iv) 

2  w(u,v) 

(E-5) 


where  we  used  (D-4),  (D-l),  and  (D-2).  The  problem  of  interest 
here  is  to  maximize  (E-5),  subject  to  constraint  ( E— 2 ) ,  by  choice 
of  nonlinearity  g. 

Since  (E-2)  is  really  two  constraints  on  the  real  and 
imaginary  parts,  we  need  two  real  Lagrange  multipliers;  letting  I 
denote  the  integral  in  (E-2),  we  must  add  to  (E-5)  the  two  real 
terms 
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Xr  Ic  +  Xi  ri  ’  Xr  *  Xi  *  H1  X*  +  r*  X)  '  (E-6) 


where  X  is  a  complex  Lagrange  multiplier.  Then,  the  essential 
quantity  we  must  maximize  is 


0  ■  rr — 2  -  x*  JJ  «  «  -  x  JJ  a*  w*  - 

| g | z  w  JJ  J J 

s 


(  E-7  ) 


where  we  have  dropped  irrelevant  scale  factors  and  adopted  an 
extremely  abbreviated  notation  for  the  time  being. 

If  we  replace 


g{u  +  iv}  by  gm(u  +  iv)  +  e  h{u  +  i-v)  • 


E-8 ) 


where  gm(  }  is  the  optimum  nonlinearity,  h{  }  is  any  perturba¬ 
tion,  and  e  is  an  arbitrary  complex  constant,  the  new  value  of  Q 


Qm  + 


(gm  +  en)  w 


(gm  +  eh)  W 


fl<> 


m  +  en)  (gm  +  eh)  w 


-  X*  JI(9m  *  cn)  «  -  X  JJ(gm  +  er,)*  M* 


(  E-9  ) 


Let  constants 


gm  w  ,  d 
in 


9ml  w  ; 


( E-l 0 ) 


N  is  complex,  while  D  is  real.  If  we  set  the  partial  derivative 


of  Qm  +  SQ  with  respect  to  e  (for  fixed  e)  equal  to  zero,  and 
then  set  e  ■  0,  e  »  0 ,  we  find  that  we  must  satisfy 
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D  N  JJ  n*  W  -  | N | 2  JT  g 


★ 

n  w 


-  x 


JJ  n*  «' 


( E-ll ) 


for  all  perturbations  h  *  h{u  +  iv}.  That  is, 


0  for  all  h  . 


( E-12 ) 


The  solution  for  the  optimum  nonlinearity  is  therefore  (dropping 
irrelevant  scale  factors) 


’m 


w 


(  E-l  3  ) 


In  order  to  solve  for  the  unknown  constants,  we  must 
substitute  (E-13)  into  the  constraint  (E-2).  But,  first,  we 
define  the  two  additional  quantities 


M  - 


(  E-l 4  ) 


M  is  real,  while  C  is  complex.  Then  the  substitution  yields 


0  -  IJ  w 


c  + 


Equation  (E-15)  can  be  solved  for 


DX  C 
N  M  * 


(E-15) 


(  E  —  1 6  ) 


Use  of  this  result  in  (E-13)  gives  the  optimum  constrained 
nonlinearity 
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gm(u  +  iv} 


W(u,v)  -  §  W*(u,v) 
””””  w(u,v)  ”  ~ 


(E-17) 


where  constants  M  and  C  are  given  by  (E-14).  By  comparison,  the 
unconstrained  optimum  nonlinearity  did  not  have  the  W*  term;  see 
(D-9) . 

The  corresponding  maximum  deflection  is  obtained  by  the  use 
of  (E-17)  and  (E-14)  in  (E-5): 


T  As(t>  " 


1 


(  E-19  ) 


The  factor 


1 


1 


(E-19) 


is  the  amount  by  which  the  constraint  (E-2)  degrades  the 
attainable  deflection;  see  (46)  and  (D-4). 
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ALTERNATIVE  APPROACH 

If  we  return  to  exact  mean  output  y^(t)  in  (18)  and  presume 

now  that  nonlinearity  g  is  analytic ,  then  a  series  expansion  in 

A  ( t )  yields  directly 
s 

yx(t)  -  y0( t)  - 

-  As(t)  exp[ i+g( t ) ]  JJ  dAn  d*n  p(An,*n)  g^{An  exp[i*nl}.  (E-20) 

The  subscript  a  on  g  denotes  that  nonlinearity  g  is  now  required 

to  be  analytic.  We  immediately  see  that  the  second  term  in  (34), 

of  the  form  A_(t)  expl-i$ (t)},  is  absent.  Now  use  (D-2)  and 
s  s 

(D-l)  to  obtain 

yx( t)  -  yQ( t)  -  Ag(t)  exp(i^s(t)]  JJ  du  dv  w(u,v)  g^{u+iv) . ( E-21 ) 

The  double  integral  in  (E-21),  denoted  by  I,  can  be  put  in 
two  different  forms:  first,  since 

^(w(u,v)  ga(u  +  iv}]  -  wx(u,v)  ga(u  +  iv}  +  w(u,v)  g'(u  +  iv}  , 

( E-22  ) 

then 

J*  du  w(u,v)  g^{u  +  iv)  » 

-  J  du  3^(w(u,v)  ga(u  +  iv}]  -  J  du  wx(u,v)  ga(u  +  iv)  .  (E-23) 
The  first  term  is 
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w(u,v)  g  {u  +  iv}  +  c(v) 


u-+® 
u»  —  • 


o  , 


( E-24 ) 


since  we  presume  that  probability  density  function  w(u,v)  goes  to 
zero  fast  enough  at  u  -  +®.  Therefore,  integrating  (E-23)  on  v, 

1  -  JJ  du  dv  w(u,v)  g^{u+iv}  -  -  JJ  du  dv  Wj^^v)  ga(u+iv}  .  (E-25) 

A  similar  approach  to  (E-22),  but  involving  3/3v  instead,  yields 
the  alternative  expression 

I  -  i  JJ  du  dv  w2(u,v)  ga(u  +  iv}  .  ( E-26 ) 

Since  (E-25)  and  (E-26)  are  equal,  we  obtain 

JJ  du  dv  W(u,v)  9a(u  +  iv}  -  0  ,  (E-27) 

where  we  used  (D-5): 

W ( u , v )  -  w1(u,v)  +  iw2(u,v)  -  +  i"g~j w ( u , v )  .  (E-28) 


But  (E-27)  is  identical  to  the  constraint  (E-2)  that  we  adopted 
earlier  in  this  appendix.  Thus,  the  assumption  of  analyticity  of 
nonlinearity  g_  automatically  realizes  the  constraint  that 
eliminates  the  second  (undesired)  term  in  (E-l).  This  is  also 
obvious  directly  from  expansion  (e-20). 

Since  I  is  given  by  both  (E-25)  and  (E-26),  it  is  also  given 
by  the  linear  combination 
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I  -  -pJJ  du  dv  wx(u,v)  ga(u+iv}  +  (l-p)i  JJ  du  dv  w2(u,v)  ga{u+iv} 


-  JJ  du  dv  ga(u+iv}  [p  w^^v)  -  i(l-p)  w2(u,v)]  ,  (E- 


where  p  is  any  complex  constant.  Notice  that  an  additive 
constant  to  g  does  not  affect  I,  since 

a 


29) 


J  du  wx(u,v)  -  J  du  w(u,v 


w(u,v)  +  c(v) 


u»+® 


Ju— ® 


0  ,  ( E-30 ) 


and  similarly, 


J  dv  w2(u,v)  •  0 


( E-31 ) 


Then,  by  reference  to  (42)  and  the  upper  line  of  (43),  the 
deflection  can  be  expressed  as 


d2-^«t, 


du  dv  ga(u+iv}Jp  w1(u,v)  -i(l-p)  w2(u,v) j l 


JJ  du  dv  |ga(u+iv}(2  w(u,v) 


•,  (E-32) 


where  we  used  (E-21),  (E-29),  (D-2),  and  (D-l).  Now  if  g  were 

“  a 

unrestricted,  the  optimum  nonlinearity  is  now 
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where  we  used  (E-28).  But  since  (E-27)  must  be  satisfied  by  this 
candidate  nonlinearity  g„.  we  find  that 


where  C  and  M  are  given  by  (E-14),  and  (E-33)  becomes  identically 
( E-17 ) . 

The  only  thing  wrong  with  this  latter  alternative  approach  in 
( E— 2 0 )  et  seq.  is  that  there  is  no  guarantee  that  (E-33)  yields 
an  analytic  nonlinearity  g  for  any  p.  Thus,  (E-33)  may  not  be  a 
valid  solution.  Furthermore,  it  is  unnecessarily  restrictive  to 
limit  g  to  being  analytic,  and  the  identical  optimum  nonlineari¬ 
ty,  obtained  earlier  in  (E-17),  was  not  restricted  to  being 
analytic.  In  summary,  (E-17)  is  the  optimum  constrained 
nonlinearity  which  eliminates  the  A_(t)  exp[~i*  (t)]  term,  while 
(D-9)  is  the  optimum  nonlinearity  which  ignores  this  latter  term. 
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